Speech recognition technology to improve retail store checkout

ABSTRACT

Systems and methods for using speech recognition technologies to facilitate retail store checkout are disclosed. According to certain aspects, an electronic device may detect a user&#39;s speech and analyze the speech to identify a set of matching items that may correspond to items being purchased by a customer. The electronic device may display, via a user interface, the set of matching items as well as a code or identification associated with the set of matching items. The user may interface with a point of sale system to input a code for a desired item, and the point of sale system may add the desired item to an order and may facilitate a checkout for the order.

FIELD

The present disclosure is directed to speech recognition technologies.In particular, the present disclosure is directed to systems and methodsfor implementing speech recognition technologies in electronic devicesto improve retail store checkout.

BACKGROUND

Retail stores, such as grocery stores and other types of stores, offer anumber of products, services, and items for purchase by customers.Typically, a customer will choose which items he or she wishes topurchase, and proceed to a point of sale system (POS) where an associateor employee of the retail store (e.g., a cashier), or self-checkoutsystem, will facilitate a checkout for the chosen items. Although manyitems include codes on their packaging (e.g., UPCs or other barcodes)that may be read or detected by a scanner, many other items, includingunpackaged items, do not include codes that may be read or detected. Ina grocery store, for example, produce and fresh bakery items include anassociated a price look-up (PLU) code that must be manually input into aPOS system.

Although some items may have the PLU affixed thereon, many items areabsent a PLU, and the cashier is therefore responsible for identifyingthe correct PLU for an item and inputting the PLU into the POS system.However, it is difficult to memorize the numerous PLUs for the numerousitems offered for sale by a retail store, and errors and inefficienciesmay result. Additionally, retail stores typically face high turnoverrates for cashiers, and training new cashiers on PLU codes is expensiveand time-consuming.

Accordingly, there is an opportunity to implement speech recognitiontechnologies in POS systems to enable retail store individuals (e.g.,cashiers) to effectively and efficiently handle item checkouts in retailstores, especially high-volume and high-frequency checkouts that ofteninclude many unpackaged items.

SUMMARY

In an embodiment, a computer-implemented method in an electronic deviceof facilitating a checkout for items to be purchased is provided. Themethod may include receiving, via a microphone, a set of audio dataannunciated by a user of the electronic device; analyzing, by aprocessor, the set of audio data to identify a set of keywords includedin the set of audio data; determining, based on the set of keywordsincluded in the set of audio data, a set of matching items; presentingthe set of matching items via a user interface of the electronic device;receiving a selection of at least one matching item of the set ofmatching items; and transmitting, to a point of sale system, anindication of the at least one matching item, wherein the point of salesystem processes a checkout of an order that includes at least the atleast one matching item.

In another embodiment, an electronic device for facilitating a checkoutfor items to be purchased is provided. The electronic device may includea memory storing a set of computer-executable instructions, a userinterface, a transceiver configured to communicate with a point of salesystem via a network connection, and a processor interfacing with thememory, the user interface, and the transceiver. The processor may beconfigured to execute the set of computer-executable instructions tocause the processor to: receive, via a microphone, a set of audio dataannunciated by a user of the electronic device, analyze the set of audiodata to identify a set of keywords included in the set of audio data,determine, based on the set of keywords included in the set of audiodata, a set of matching items, cause the user interface to present theset of matching items, receive a selection of at least one matching itemof the set of matching items, and transmit, to the point of sale systemvia the transceiver, an indication of the at least one matching item,wherein the point of sale system processes a checkout of an order thatincludes at least the at least one matching item.

In another embodiment, a system for facilitating a checkout for items tobe purchased is provided. The system may include a mobile devicecomprising: a first memory storing a first set of computer-executableinstructions, a user interface, and a first processor interfacing withthe first memory and the user interface. The first processor may beconfigured to execute the first set of computer-executable instructionsto cause the first processor to receive a set of audio data via amicrophone, analyze the set of audio data to identify a set of keywordsincluded in the set of audio data, determine, based on the set ofkeywords included in the set of audio data, a set of matching items, andcause the user interface to present (i) the set of matching items, and(ii) a set of codes respectively associated with the set of matchingitems. The system may further include a point of sale device comprising:a second memory storing a second set of computer-executableinstructions, and a second processor interfacing with the second memory.The second processor may be configured to execute the second set ofcomputer-executable instructions to cause the second processor toreceive at least one code of the set of codes respectively correspondingto at least one matching item of the set of matching items, and processa checkout of an order that includes the at least one matching item.

In a further embodiment, an electronic device for facilitating acheckout for items to be purchased is provided. The electronic devicemay include a memory storing a set of computer-executable instructions,a user interface, and a processor interfacing with the memory and theuser interface, and configured to execute the set of computer-executableinstructions to cause the processor to: cause the user interface topresent a set of training words, receive, via a microphone, a set oftraining audio data representing the set of training words annunciatedby a user of the electronic device, based on the set of training audiodata, establish a baseline speech pattern associated with the user,receive, via the microphone, a set of audio data annunciated by theuser, analyze the set of audio data to identify a set of keywordsincluded in the set of audio data, determine, based on the set ofkeywords included in the set of audio data, a set of matching items, andcause the user interface to present the set of matching items.

BRIEF DESCRIPTION OF THE FIGURES

FIG. 1 depicts an overview of components and entities associated withthe systems and methods, in accordance with some embodiments.

FIG. 2 depicts an example signal diagram associated with implementingspeech recognition technologies into retail store checkouts, inaccordance with some embodiments.

FIG. 3 depicts an example user interface associated with a training modeof an application, in accordance with some embodiments.

FIGS. 4 and 5 depict example user interfaces associated with a checkoutmode of an application, in accordance with some embodiments

FIG. 6 depicts an example flow diagram associated with facilitating acheckout for items to be purchased, in accordance with some embodiments.

FIG. 7 is a hardware diagram of an example electronic device and examplePOS system, in accordance with some embodiments.

DETAILED DESCRIPTION

The present embodiments may relate to, inter alia, implementing speechrecognition technologies in electronic components associated with aretail store checkout. According to certain aspects, an individualassociated with a retail store (e.g., a cashier) may dictate orannunciate items included in a checkout order of a customer, where anelectronic device may detect the individual's voice in the form of audiodata, identify a set of keywords included in the audio data, anddetermine a set of items that match the set of keywords. Further, theelectronic device may indicate, via a user interface, the set of itemsand identifying information (e.g., a set of PLUs) related thereto forreview by the individual. The individual may input or otherwise causethe identifying information of an item to be communicated to a POSsystem so that the POS system may add the item to the checkout order ofthe customer.

The systems and methods therefore offer numerous benefits. Inparticular, the systems and methods improve how codes such as PLUs areidentified and input into a POS system. Further, the systems and methodsreduce the need for cashiers to memorize item codes such as PLUs, whichmay reduce the expenses and time associated with cashier training andresult in lower cashier turnover. For example, the systems and methodsmay reduce the amount of time needed to train cashiers by a significantamount, thus reducing costs and enabling retail stores to offer morecompetitive or above-market wages. Additionally, the systems and methodsimprove the checkout experience for customers, as cashiers do not needto manually access charts or guides that list codes such as PLUs. Itshould be appreciated that additional benefits are envisioned.

The systems and methods discussed herein address a challenge that isparticular to managing retail store checkouts. In particular, thechallenge relates to a difficulty in effectively and efficientlyfacilitating customer checkouts in retail stores. Conventionally, retailstore cashiers either memorize or manually look up codes associated withunmarked and/or unpackaged items. However, memorization and manuallookup is time-consuming, frustrating, and challenging, especially inretail stores having high-volume and high-frequency checkouts. Thesystems and methods offer improved capabilities to solve these problemsby utilizing speech recognition technologies that analyze cashier speechto determine items included in checkout orders. The systems and methodsenable the POS system to receive identifications of the items so thatthe POS system may effectively and efficiently add the items to thecorresponding orders. Further, because the systems and methods employthe capture, analysis, and transmission of data between and amongmultiple devices, the systems and methods are necessarily rooted incomputer technology in order to overcome the noted shortcomings thatspecifically arise in the realm of managing retail store checkouts.

According to implementations, the systems and methods may support adynamic, real-time or near-real-time communication, analysis, andprocessing of data. In particular, the systems and methods may analyzedetected audio data in real-time or near real-time, automatically anddynamically display matching items in real-time or near real-time, andfacilitate checkout functionalities in real-time or near-real-time.

FIG. 1 illustrates an overview of a system 100 of components configuredto facilitate the systems and methods. It should be appreciated that thesystem 100 is merely an example and that alternative or additionalcomponents are envisioned.

As illustrated in FIG. 1, the system 100 may include a set of front-endcomponents 101 and a set of back-end components 102. In embodiments, theset of front-end components 101 may be located in or otherwiseassociated with a retail store, shop, place of business, or the like (asused herein “retail store”), and the set of back-end components 102 maybe associated with the retail store and located remotely from the retailstore. In an implementation, the back-end components 102 may be locatedwithin the retail store. The retail store may offer a set of items,products, services, or the like (as used herein, “items”) that may beselected and purchased by customers, patrons, users, or the like (asused herein, “customers”) of the retail store.

The set of front-end components 101 may be used or interfaced by a user103 and a user 104. In embodiments, the user 103 may be a customer ofthe retail store and the user 104 may be an employee, contractor,volunteer, or other individual associated with the retail store. Asdescribed herein, the user 104 may be a cashier who may be responsiblefor facilitating checkout processes with customers, however it should beappreciated that the user 104 may have alternative or additionalresponsibilities.

Generally, the user 103 may select a set of items 106 for purchase fromthe retail store. The set of front-end components 101 may include acheckout lane 107 or similar area to which the user 103 may bring theset of items 106 for checkout. The user 104 may assist or help the user103 complete the checkout of the set of items 106. Although theembodiments are described as including the user 104, it should beappreciated that the user 103 (e.g., a customer) may facilitate aself-checkout from the checkout lane 107 without involvement of the user104. In this scenario, the user 103 may perform the actions otherwisereserved for the user 104.

The front-end components 101 may further include an electronic device105 and a POS system 110 that the user 104 may use or interface with tofacilitate the checkout of the set of items 106. Although FIG. 1 depictsthe electronic device 105 and POS system 110 as separate components, itshould be appreciated that the electronic device 105 and POS system 110may be combined into a single electronic device.

The electronic device 105 may be any type of electronic device such as amobile device (e.g., a smartphone), notebook or desktop computer,tablet, phablet, GPS (Global Positioning System) or GPS-enabled device,smart watch, smart glasses, smart bracelet, wearable electronic, PDA(personal digital assistant), pager, computing device configured forwireless communication, and/or the like. Similarly, the POS system 110may be an electronic device or combination of electronic components,such as a mobile device (e.g., a smartphone), notebook or desktopcomputer, tablet, phablet, PDA (personal digital assistant), computingdevice configured for wireless communication, and/or the like.Additionally or alternatively, the POS system 110 may include a displaycomponent with a user interface (e.g., a monitor), and may support acombination of hardware and software components.

According to embodiments, each of the electronic device 105 and the POSsystem 110 may be configured with a user interface (e.g., a touchscreen,monitor, or other user interface), configured to connect to one or moreperipheral components (e.g., keyboard, mouse, external speaker, externalmicrophone), and/or configured with built-in audio components (e.g.,speaker, microphone). Additionally, each of the electronic device 105and the POS system 110 may be configured to execute a set ofapplications that may facilitate the functionalities of the systems andmethods.

The electronic device 105 and the POS system 110 may be configured todirectly connect and/or communicate with each other via a networkconnection 112, where the network connection 112 may be any type of datacommunication via any standard or technology (e.g., GSM, CDMA, TDMA,WCDMA, LTE, EDGE, OFDM, GPRS, EV-DO, UWB, Internet, IEEE 802 includingEthernet, WiMAX, Wi-Fi, Bluetooth, and others). In an embodiment, thenetwork connection 112 may support a short-range communication such asNFC, RFID, and/or the like.

As illustrated in FIG. 1, the back-end components 102 may include aprocessing server 115 and storage 116, where one or both of theelectronic device 105 and the POS system 110 may be configured tocommunicate with the processing server 115 via the one or more networks112. The processing server 115 may be associated with the retail store,and optionally with additional location(s) of the retail store. Inembodiments, the network(s) 112 may support any type of datacommunication via any standard or technology (e.g., GSM, CDMA, TDMA,WCDMA, LTE, EDGE, OFDM, GPRS, EV-DO, UWB, Internet, IEEE 802 includingEthernet, WiMAX, Wi-Fi, Bluetooth, and others). The processing server115 may be configured to interface with or support the storage 116capable of storing various data. In one implementation, the storage 116may include a database that stores information related to items for salein the retail store. In embodiments, the processing server 115 may belocated at or within the retail store, or may be located remote from theretail store (i.e., the processing server 115 may be cloud-based).

The processing server 115 may be configured to maintain informationassociated with an inventory of items in the retail store, where theinformation may represent real-time or near real-time inventoryinformation, and where the storage 116 may store the information. Theprocessing server 115 may update the information with any received iteminformation, such as if a shipment of items is received. The processingserver 115 may be configured to communicate, via the network(s) 112, anyportion of the information to one or both of the POS system 110 and theelectronic device 105, such as in response to a request, periodically,or when updated information is received. According to embodiments, theinformation may include identifications of items (e.g., a UPC or PLU),descriptions of items, images of items, pricing information, inventoryinformation, locations of the items within the retail store, and/orother information. It should be appreciated that either or both of thePOS system 110 and electronic device 105 may similarly maintaininventory information.

The retail store may support a portal, application, or the like, thatmay interface with the processing server 115 to import or update item orproduct information, such as pricing, new or existing item availability,inventory, images, descriptions, locations within the retail store,and/or other information. In this regard, the processing server 115 maysupport and manage item information for a plurality of retail stores,including different companies. It should be appreciated that the retailstore may facilitate the import or update at any time. Similarly, theprocessing server 115 may push the imported or updated information tothe electronic device 105 and/or the POS system 110, and/or theelectronic device 105 and/or the POS system 110 may pull the imported orupdated information from the processing server 115. Accordingly, theelectronic device 105 and/or the POS system 110 may maintain and/oraccess updated item information.

In operation, when the user 103 is ready to complete a checkout for theset of items 106, the user 104 may use either the POS system 110 orelectronic device 105 to initiate a checkout. The electronic device 105may prompt the user 104 to annunciate or speak an identification of eachitem in the set of items 106. A microphone of the electronic device 105may detect the speech, and the electronic device 105 may analyze thespeech to determine a set of keywords included in the speech. Further,the electronic device 105 may identify a set of items that match the setof keywords, and may display, via a user interface, the set of matchingitems along with an identification (e.g., a UPC or PLU) of each of theset of matching items. The user 104 may interface with the POS system110 via the user interface to input the identification of a desiredmatching item, where the POS system 110 may add the inputted item to acheckout order. Additional details and functionalities associated withthese components are described further with respect to FIG. 2.

FIG. 2 depicts a signal diagram 200 associated with facilitating a storecheckout using speech recognition technologies. The signal diagram 200includes a point of sale (POS) system 210 (such as the POS system 110 asdiscussed with respect to FIG. 1), a mobile device 205 (such as themobile device 105 as discussed with respect to FIG. 1), and a server 215(such as the server 115 as discussed with respect to FIG. 1). The pointof sale system 210 and the mobile device 205 may be located in a retailstore, and may be operated autonomously or by an individual inassociation with a checkout procedure. The server 215 may be locatedwithin the retail store or may be located remotely from the retailstore, and may be configured to communicate with either or both of thepoint of sale system 210 and the mobile device 205. Each of the mobiledevice 205 and the POS system 210 may be configured to implement andexecute one or more applications configured to facilitate the respectivedescribed functionalities.

The signal diagram 200 may begin when the server 215 initiates (220) asynchronization of items and information with the mobile device 205. Inparticular, the server 215 may manage, in real-time or near-real time,an inventory of items for sale in the retail store, where thesynchronization may reflect the inventory of items. As a result, theserver 215 may provide the mobile device 205 with an accurate inventoryof the products for sale in the retail store as well as informationassociated with the products. For example, the information may includeprice (e.g., flat price per item or price per unit weight), saleinformation (e.g., sale price or sale effective dates), a PLU, alocation of the item within the store, an image(s) of the item, adescription of the item, and/or other information. According toembodiments, the server 215 may initiate the synchronizationautomatically (e.g., in response to obtaining updated inventory data),periodically (e.g., once/day), or in response to a request from themobile device 205 or another component.

Additionally or alternatively, the server 215 may initiate (222) asynchronization of items and information with the POS system 210. In oneimplementation, the server 215 may synchronize directly with the POSsystem 210. In another implementation, the server 215 may synchronizeindirectly with the POS system 210 via the mobile device 205. In eitherimplementation, the server 205 may provide to the POS system 210 thesame information (or different information) that the server 215 providesto the mobile device 205 in the synchronization of (220).

The mobile device 205 may administer (224) a training with a user of themobile device 205. In embodiments, the mobile device 205 may administerthe training independently from any synchronization with the server 215.Further, the mobile device 205 may repeatedly administer the training tothe same user, or to additional users. It should be appreciated that themobile device 205 may locally administer the training, or may interfacewith the server 215 (e.g., via a website) to initiate and administer thetraining.

In an implementation, the training may be designed to calibrate oranalyze a user's voice and/or speech patterns. In operation, thetraining may instruct the user to recite a set of words or phrases thatthe mobile device 205 may detect via a built-in or external microphone.The mobile device 205 may further analyze the detected words or phrasesto establish a baseline associated with the user's voice and/or speechpatterns, which the mobile device 205 may use in subsequent analyses ofthe user's speech. In an implementation, the mobile device 205 may senddata associated with the training to the server 215 for storage thereon.It should be appreciated that the mobile device 205 may administer,assess, compile, and analyze the training functionalities according toany technique, calculation, algorithm, and/or the like.

The mobile device 205 may initiate (226) a checkout session, which maybe independent from administration of the training. In embodiments, themobile device 205 may initiate the checkout session when a customerassociated with the retail store wishes to purchase items offered in theretail store. The mobile device 205 may automatically initiate thecheckout session in response to a trigger (e.g., a completion of aprevious checkout session) or a user of the mobile device 205 maymanually initiate the checkout session. In an implementation, the POSsystem 210 may send a signal or command to the mobile device 205 toinitiate the checkout session. According to embodiments, in initiatingthe checkout session, the mobile device 205 may instruct the user toannunciate or speak identifications of items that the customer desiresto purchase. In an implementation, the customer him/herself may initiateand conduct the checkout session without assistance from the user.

The mobile device 205 may detect (228) audio or speech of the userindicative of the items for purchase. In particular, the mobile device205 may detect the audio or speech via a microphone, such as anintegrated microphone or a peripheral microphone (e.g., in a headset).In embodiments, the mobile device 205 may instruct or guide the user inannunciating or speaking the words so that the user may know when toannunciate or speak.

The mobile device 205 may analyze (230) the detected audio to identify aset of keywords included in the detected audio. It should be appreciatedthat the mobile device 205 may utilize any type of speech recognition(SR) technology, algorithm, or the like in analyzing the detected audio.For example, the mobile device 205 may utilize a hidden Markov model(HMM), dynamic time warping (DTW), artificial neural network(s), deepfeedforward and recurrent neural networks, end-to-end automatic speechrecognition, and/or other techniques. In analyzing the detected audio,the mobile device 205 may utilize any data associated with the trainingof the user. In particular, the mobile device 205 may utilize thebaseline information associated with the speech of the user, which mayresult in a more accurate speech recognition (i.e., more accurateidentified set of keywords). In an implementation, the mobile device 205may transmit the detected audio data to the server 215, the server 215may analyze the detected audio, and the server 215 may transmit theidentified set of keywords to the mobile device 205.

In an additional or alternative implementation, the mobile device 205may capture, or receive as input, image data that may depict an item(s)for purchase. In particular, the mobile device 205 may include or mayinterface with a set of image sensors configured to capture a set ofimage data depicting the item(s). For example, the set of image sensorsmay be disposed in proximity to a checkout location in a retail store.Accordingly, the mobile device 205 may analyze the set of image dataaccording to various calculations or techniques to identify the item(s)that may be depicted in the set of image data. The mobile device 205 mayuse various computer vision techniques, including optical characterrecognition (OCR), object recognition, and other techniques.Additionally or alternatively, the mobile device 205 may support text tospeech functionalities, where the mobile device 205 may annunciate aninputted text string, such as if the user does not know how to pronouncea certain item.

The mobile device 205 may identify and display (232) item(s) that matchthe set of keywords. According to embodiments, the mobile device 205 mayfacilitate a query against any stored inventory information (or otherstored information) and using the set of keywords to identify thematching item(s). It should be appreciated that the mobile device 205may employ any type of query according to any technique or algorithm. Inan embodiment, the mobile device 205 may enable the user to select oneor more filters that the mobile device 205 may use in its query. Forexample, the filters may specify produce versus non-produce, favorites,color, size, geography, best sellers, seasonal, source of origin,organic, gluten free, location within store, and/or other filters. Itshould be appreciated that the mobile device 205 may perform the querylocally, or may interface with the server 215 to perform the query.

The mobile device 205 may present information associated with thematching item(s) in a user interface. In particular, the mobile device205 may present, for each matching item(s), an identification of theitem, an image of the item, a description of the item, pricinginformation, a PLU or other code associated with the item, and/or otherrelevant information. In an embodiment, the user may select, via theinterface, to view more information associated with a particular item.In an embodiment, the mobile device 205 may identify a respectivepopularity of each of the matching item(s), and may rearrange thematching item(s) based on the popularity(ies).

In an implementation, the mobile device 205 may receive (234) aselection of one of the matching item(s), where the user may select theitem via the user interface of the mobile device 205. In embodiments,the mobile device 205 may receive the selection via a touch selection bya user, via a voice command from the user, via a peripheral component(e.g., a keyboard) or via another channel. The user may additionally usethe mobile device 205 to input or select information associated with theselected item, such as a weight of the selected item, a quantity of theselected item, and/or additional information. In an implementation, themobile device 205 may generate or identify a set of keywords to be usedin item queries based on various selections by the user, such as itemselections, filter selections, and/or the like, which the applicationmay use in subsequent queries.

After the mobile device 205 receives the selection, the mobile device205 may transmit (236) an indication(s) of the selected item(s) to thePOS system 210. The mobile device 205 may also transmit any additionalinformation inputted by the user (e.g., a weight or quantity of theselected items). In embodiments, the indication(s) of the selecteditem(s) may be in the form of an identification (e.g., a unique codesuch as a PLU) associated with the selected item(s).

In an alternative or additional implementation, the POS system 210 mayreceive (238) an indication(s) of an item(s). In this implementation,the user may interface with the POS system 210 to input anidentification (e.g., a unique code such as a PLU) associated with anitem(s), where the item(s) may be one of the matching items(s) displayedby the mobile device 205 and where the identification may be displayedwith the corresponding matching item by the mobile device 205. Thus, theuser of the mobile device 205 may reference the matching item and itsidentification in association with inputting the identification into thePOS system 210. In embodiments, the user may input the indication(s) ofthe item(s) via a user interface of the POS system 210, such as by usinga touch screen, reciting a voice command, using a peripheral component(e.g., a keyboard), or via another channel.

The POS system 210 may add (240) any inputted or selected item(s) to theorder. In particular, the POS system 210 may add, to the order, anyitem(s) indicated in communications from the mobile device 205. The POSsystem 210 may interface with a scale to receive a weight of an inputtedor selected item(s), and may manage or modify the order according to thereceived weight. After all items have been added to the order, the POSsystem 210 may process (242) a checkout of the order. In particular, thePOS system 210 may receive an indication that the order is complete, andmay facilitate payment of the order by the customer, providing of areceipt to the customer, and/or other functionalities.

The electronic device 205 may continuously or periodically provide ordisplay notifications that may indicate a progress or performance of theuser. For example, the notifications may indicate areas of improvement(e.g., displaying images of cilantro and parsley and highlightingdifferences thereof), or may provide positive reinforcement (e.g.,“great job identifying the tomatillos!”).

FIGS. 3-5 illustrate example interfaces associated with the systems andmethods. An electronic device (e.g., a mobile device such as a tablet, aPOS system, etc.) may be configured to display the interfaces and/orreceive selections and inputs via the interfaces, where the electronicdevice may be associated with a retail store. One or more dedicatedapplications that are configured to operate on the electronic device maydisplay the interfaces. It should be appreciated that the interfaces aremerely examples and that alternative or additional content isenvisioned.

FIG. 3 illustrates an interface 350 depicting a training mode for anapplication. In embodiments, a user of the electronic device (e.g., acashier) may initiate the training mode that may be designed to recordand establish a baseline for the user's voice or speech. The interface350 may direct the user to recite a set of words 352 (as shown: apple,banana, onion, bread, milk). A microphone associated with the electronicdevice may detect the set of words 352 in succession and the interface350 may display an updated status of the detection. In particular, asshown in FIG. 3, the interface 350 indicates, via a set of check marks,that the electronic device has detected the words “apple,” “banana,”“onion,” and “bread.” Further, the interface 350 indicates that theelectronic device is listening for the word “milk.”

The interface 350 may further include an “exit” selection 351 that, uponselection, may cause the application to exit the training mode. Further,the interface 350 may include a “next” selection 353 that, uponselection, may cause the application to proceed to additionalfunctionality. The interface 350 depicts that the “next” selection 353as dashed, where the “next” selection 353 may transition to selectablewhen the electronic device detects all words included in the set ofwords 352.

FIG. 4 illustrates an interface 450 depicting a checkout mode for theapplication. According to embodiments, the checkout mode may beassociated with a customer purchasing a set of items from the retailstore. In embodiments, the checkout mode and the training mode may beassociated with the same application or different applications. As shownin FIG. 4, the interface 450 may instruct the user (e.g., a cashier) torecite the items that the customer is purchasing. Further, the interface450 indicates that the electronic device is detecting the user's voice,such as via a microphone. The interface 450 may include an “exit”selection 451 that, upon selection, may cause the application to exitthe checkout mode. The interface 450 may further include a “finish”selection 452 that, upon selection, may cause the application toinitiate a set of functionalities related to completion of the checkout.

FIG. 5 illustrates another interface 550 depicting the checkout mode forthe application. According to embodiments, the application may displaythe interface 550 after detecting and analyzing a user's voice. Inparticular, the application may display the interface 550 afteridentifying a set of keywords in the captured audio and determining aset of matching items based on the set of keywords.

As shown in FIG. 5, the interface 550 may indicate (557) that the word“banana” was detected. Accordingly, the interface 550 may include a setof matching items 551, including “yellow bananas,” “organic bananas,”and “banana peppers.” The set of matching items 551 further includes aset of information associated with each matching item (as shown: animage and a PLU). The interface 550 may enable the user to select adesired item(s) from the set of matching items (as shown the userselects (552) “yellow bananas”). It should be appreciated that otheroptions (e.g., quantity selection, weight input) are envisioned. Theinterface 550 may include a “load more” selection 554 that, uponselection, may cause the application to display additional matchingitem(s).

The interface 550 may further include a “speak” selection 555 that, uponselection, may cause the application to display the interface 450 ofFIG. 4 and detect additional audio. Additionally, the interface 550 mayinclude an “exit” selection 556 that, upon selection, may cause theelectronic device to exit the interface 550 and any associatedfunctionality.

In an implementation, the interface 550 may include a “transmit”selection 553 that, upon selection, may cause the electronic device totransmit an indication of the selected item to another component, suchas a POS system. In this embodiment, the POS system may receive theindication and may add the selected item to the checkout order. Inanother implementation, the user may interface with the POS system (orsimilar component) and input an identification of a desired item. Forexample, the user may notice that the customer wishes to purchaseorganic peppers having a PLU of 14517, and may input this PLU into thePOS system.

FIG. 6 depicts is a block diagram of an example method 600 offacilitating a checkout for items to be purchased. The method 600 may befacilitated by an electronic device (such as the mobile device 205 asdiscussed with respect to FIG. 2) that may be incorporated within orcapable of communication with a POS system (such as the POS system 210as discussed with respect to FIG. 2).

The method 600 may begin when the electronic device optionally initiatesa training mode or feature for a user of the electronic device. Inparticular, the electronic device may present (block 605), via a userinterface of the electronic device, a set of training words. Inembodiments, the electronic device may instruct the user to recite orannunciate the set of training words. The electronic device may receive(block 610), via a microphone, a set of training audio data representingthe set of training words annunciated by the user of the electronicdevice. Based on the set of training audio data, the electronic devicemay establish (block 615) a baseline speech pattern associated with theuser. In embodiments, the electronic device may locally store thebaseline speech pattern or cause an external device or server to storethe baseline speech pattern.

Separate from the functionalities of the training mode, the electronicdevice may initiate a checkout procedure associated with a customerpurchasing a set of items. Thus, the electronic device may activate anyspeech recognition features and accordingly the electronic device mayreceive (block 620), from a microphone, a set of audio data annunciatedby the user, where the set of audio data may correspond to one or moreof the set of items to be purchased. The electronic device may analyze(block 625) the set of audio data to identify a set of keywords includedin the set of audio data. In an embodiment, the electronic device mayanalyze the set of audio data according to the baseline speech patternof the user. It should be appreciated that the electronic device mayemploy any technique, algorithm, calculation, and/or the like inanalyzing the set of audio data.

The electronic device may determine (block 630), based on the set ofkeywords included in the audio data, a set of matching items. Inembodiments, the electronic device may perform a query using the set ofkeywords, where the set of matching items may be returned from the querybased on at least one of the set of keywords being included in each ofthe set of matching items. In an implementation, the electronic devicemay interface with another local or remote device, server, or componentto perform the query. In an optional implementation, the electronicdevice may modify (block 635) the set of matching items according to apopularity associated with each of the set of matching items. Inparticular, the electronic device may rearrange an ordering of the setof matching items according to a popularity of the set of matchingitems.

The electronic device may present (block 640), via the user interface,the set of matching items and a set of codes respectively associatedwith the set of matching items. In embodiments, the electronic devicemay also present additional information associated with the set ofmatching items, including a set of images and/or various itemdescriptions. The electronic device may receive (block 645) a selectionof at least one matching item of the set of matching items. In anembodiment, the electronic device may receive the selection via atouch-sensitive surface of a user interface. In another embodiment, inreceiving the selection, the electronic device may receive an additionalset of audio data via the microphone, and may analyze the additional setof audio data to identify the at least one matching item included in theadditional set of audio data.

The electronic device may transmit (block 650), to a point of salesystem, an indication of the at least one matching item, where the pointof sale system may process a checkout of an order that includes at leastthe at least one matching item. In embodiments, the electronic devicemay transmit the indication to the point of sale system via any type ofnetwork connection. In an implementation, as discussed herein, the usermay interface with the point of sale system to input the indication ofthe at least one matching item, and the point of sale system maycomplete the checkout accordingly.

FIG. 7 illustrates a hardware diagram of an example electronic device705 (such as the mobile device 205 as discussed with respect to FIG. 2)and an example POS system 710 (such as the POS system 210 as discussedwith respect to FIG. 2), in which the functionalities as discussedherein may be implemented. It should be appreciated that the electronicdevice 705 and the POS system 710 may be associated with a retail storehaving available a set of items for purchase by customers. It should beappreciated that the electronic device 705 and the POS system 710 may becombined into a single device.

The electronic device 705 may include a processor 772 as well as amemory 778. The memory 778 may store an operating system 779 capable offacilitating the functionalities as discussed herein as well as a set ofapplications 775 (i.e., machine readable instructions). For example, oneof the set of applications 775 may be a checkout application 790configured to facilitate speech recognition technologies in an ordercheckout. It should be appreciated that one or more other applications792 are envisioned, such as a speech recognition training application.

The processor 772 may interface with the memory 778 to execute theoperating system 779 and the set of applications 775. According to someembodiments, the memory 778 may also include product or item data 780including data or information associated with a set of items for sale ina retail store. The memory 778 may include one or more forms of volatileand/or non-volatile, fixed and/or removable memory, such as read-onlymemory (ROM), electronic programmable read-only memory (EPROM), randomaccess memory (RAM), erasable electronic programmable read-only memory(EEPROM), and/or other hard drives, flash memory, MicroSD cards, andothers.

The electronic device 705 may further include a communication module 777configured to communicate data via one or more networks 712. Accordingto some embodiments, the communication module 777 may include one ormore transceivers (e.g., WWAN, WLAN, and/or WPAN transceivers)functioning in accordance with IEEE standards, 3GPP standards, or otherstandards, and configured to receive and transmit data via one or moreexternal ports 776. For example, the communication module 777 mayreceive, from a backend server via the network 712, information relatedto inventory and pricing updates. For further example, the communicationmodule 777 may transmit, to the backend server via the network 712,captured audio data for analysis by the backend server.

The electronic device 705 may further include a user interface 781configured to present information to a user and/or receive inputs fromthe user. As shown in FIG. 7, the user interface 781 may include adisplay screen 782 and I/O components 783 (e.g., ports, capacitive orresistive touch sensitive input panels, keys, buttons, lights, LEDs).According to some embodiments, the user may access the electronic device705 via the user interface 781 to review information, make selections,and/or perform other functions. Additionally, the electronic device 705may include a speaker 773 configured to output audio data and amicrophone 774 configured to detect audio.

In some embodiments, the electronic device 705 may perform thefunctionalities as discussed herein as part of a “cloud” network or mayotherwise communicate with other hardware or software components withinthe cloud to send, retrieve, or otherwise analyze data.

As illustrated in FIG. 7, the electronic device 705 may communicate andinterface with the POS system 710 via the network(s) 712. The POS system710 may include a processor 759 as well as a memory 756. The memory 756may store an operating system 757 capable of facilitating thefunctionalities as discussed herein as well as a set of applications 751(i.e., machine readable instructions). For example, one of the set ofapplications 751 may be a checkout application 752 configured tofacilitate an order checkout. It should be appreciated that one or moreother applications 753 are envisioned.

The processor 759 may interface with the memory 756 to execute theoperating system 757 and the set of applications 751. According to someembodiments, the memory 756 may also include product or item data 758including data or information associated with a set of items for sale ina retail store. The memory 756 may include one or more forms of volatileand/or non-volatile, fixed and/or removable memory, such as read-onlymemory (ROM), electronic programmable read-only memory (EPROM), randomaccess memory (RAM), erasable electronic programmable read-only memory(EEPROM), and/or other hard drives, flash memory, MicroSD cards, andothers.

The POS system 710 may further include a communication module 755configured to communicate data via the one or more networks 712.According to some embodiments, the communication module 755 may includeone or more transceivers (e.g., WWAN, WLAN, and/or WPAN transceivers)functioning in accordance with IEEE standards, 3GPP standards, or otherstandards, and configured to receive and transmit data via one or moreexternal ports 754. For example, the communication module 755 mayreceive, from the electronic device 705, identifications of items to addto an order.

The POS system 710 may further include a user interface 762 configuredto present information to a user and/or receive inputs from the user. Asshown in FIG. 7, the user interface 762 may include a display screen 763and I/O components 764 (e.g., ports, capacitive or resistive touchsensitive input panels, keys, buttons, lights, LEDs). According to someembodiments, the user may access the POS system 710 via the userinterface 762 to review information, make selections (e.g., inputitems), facilitate payment from a customer, and/or perform otherfunctions. Additionally, the POS system 710 may include a speaker 760configured to output audio data and a microphone 761 configured todetect audio.

In some embodiments, the POS system 710 may perform the functionalitiesas discussed herein as part of a “cloud” network or may otherwisecommunicate with other hardware or software components within the cloudto send, retrieve, or otherwise analyze data.

In general, a computer program product in accordance with an embodimentmay include a computer usable storage medium (e.g., standard randomaccess memory (RAM), an optical disc, a universal serial bus (USB)drive, or the like) having computer-readable program code embodiedtherein, wherein the computer-readable program code may be adapted to beexecuted by the processors 772, 759 (e.g., working in connection withthe respective operating systems 779, 757) to facilitate the functionsas described herein. In this regard, the program code may be implementedin any desired language, and may be implemented as machine code,assembly code, byte code, interpretable source code or the like (e.g.,via C, C++, Java, Actionscript, Objective-C, Javascript, CSS, XML). Insome embodiments, the computer program product may be part of a cloudnetwork of resources.

Although the following text sets forth a detailed description ofnumerous different embodiments, it should be understood that the legalscope of the invention may be defined by the words of the claims setforth at the end of this patent. The detailed description is to beconstrued as exemplary only and does not describe every possibleembodiment, as describing every possible embodiment would beimpractical, if not impossible. One could implement numerous alternateembodiments, using either current technology or technology developedafter the filing date of this patent, which would still fall within thescope of the claims.

Throughout this specification, plural instances may implementcomponents, operations, or structures described as a single instance.Although individual operations of one or more methods are illustratedand described as separate operations, one or more of the individualoperations may be performed concurrently, and nothing requires that theoperations be performed in the order illustrated. Structures andfunctionality presented as separate components in example configurationsmay be implemented as a combined structure or component. Similarly,structures and functionality presented as a single component may beimplemented as separate components. These and other variations,modifications, additions, and improvements fall within the scope of thesubject matter herein.

Additionally, certain embodiments are described herein as includinglogic or a number of routines, subroutines, applications, orinstructions. These may constitute either software (e.g., code embodiedon a non-transitory, machine-readable medium) or hardware. In hardware,the routines, etc., are tangible units capable of performing certainoperations and may be configured or arranged in a certain manner. Inexample embodiments, one or more computer systems (e.g., a standalone,client or server computer system) or one or more hardware modules of acomputer system (e.g., a processor or a group of processors) may beconfigured by software (e.g., an application or application portion) asa hardware module that operates to perform certain operations asdescribed herein.

In various embodiments, a hardware module may be implementedmechanically or electronically. For example, a hardware module maycomprise dedicated circuitry or logic that may be permanently configured(e.g., as a special-purpose processor, such as a field programmable gatearray (FPGA) or an application-specific integrated circuit (ASIC)) toperform certain operations. A hardware module may also compriseprogrammable logic or circuitry (e.g., as encompassed within ageneral-purpose processor or other programmable processor) that may betemporarily configured by software to perform certain operations. Itwill be appreciated that the decision to implement a hardware modulemechanically, in dedicated and permanently configured circuitry, or intemporarily configured circuitry (e.g., configured by software) may bedriven by cost and time considerations.

Accordingly, the term “hardware module” should be understood toencompass a tangible entity, be that an entity that is physicallyconstructed, permanently configured (e.g., hardwired), or temporarilyconfigured (e.g., programmed) to operate in a certain manner or toperform certain operations described herein. Considering embodiments inwhich hardware modules are temporarily configured (e.g., programmed),each of the hardware modules need not be configured or instantiated atany one instance in time. For example, where the hardware modulescomprise a general-purpose processor configured using software, thegeneral-purpose processor may be configured as respective differenthardware modules at different times. Software may accordingly configurea processor, for example, to constitute a particular hardware module atone instance of time and to constitute a different hardware module at adifferent instance of time.

Hardware modules may provide information to, and receive informationfrom, other hardware modules. Accordingly, the described hardwaremodules may be regarded as being communicatively coupled. Where multipleof such hardware modules exist contemporaneously, communications may beachieved through signal transmission (e.g., over appropriate circuitsand buses) that connect the hardware modules. In embodiments in whichmultiple hardware modules are configured or instantiated at differenttimes, communications between such hardware modules may be achieved, forexample, through the storage and retrieval of information in memorystructures to which the multiple hardware modules have access. Forexample, one hardware module may perform an operation and store theoutput of that operation in a memory device to which it may becommunicatively coupled. A further hardware module may then, at a latertime, access the memory device to retrieve and process the storedoutput. Hardware modules may also initiate communications with input oroutput devices, and may operate on a resource (e.g., a collection ofinformation).

The various operations of example methods described herein may beperformed, at least partially, by one or more processors that aretemporarily configured (e.g., by software) or permanently configured toperform the relevant operations. Whether temporarily or permanentlyconfigured, such processors may constitute processor-implemented modulesthat operate to perform one or more operations or functions. The modulesreferred to herein may, in some example embodiments, compriseprocessor-implemented modules.

Similarly, the methods or routines described herein may be at leastpartially processor-implemented. For example, at least some of theoperations of a method may be performed by one or more processors orprocessor-implemented hardware modules. The performance of certain ofthe operations may be distributed among the one or more processors, notonly residing within a single machine, but deployed across a number ofmachines. In some example embodiments, the processor or processors maybe located in a single location (e.g., within a home environment, anoffice environment, or as a server farm), while in other embodiments theprocessors may be distributed across a number of locations.

The performance of certain of the operations may be distributed amongthe one or more processors, not only residing within a single machine,but deployed across a number of machines. In some example embodiments,the one or more processors or processor-implemented modules may belocated in a single geographic location (e.g., within a homeenvironment, an office environment, or a server farm). In other exampleembodiments, the one or more processors or processor-implemented modulesmay be distributed across a number of geographic locations.

Unless specifically stated otherwise, discussions herein using wordssuch as “processing,” “computing,” “calculating,” “determining,”“presenting,” “displaying,” or the like may refer to actions orprocesses of a machine (e.g., a computer) that manipulates or transformsdata represented as physical (e.g., electronic, magnetic, or optical)quantities within one or more memories (e.g., volatile memory,non-volatile memory, or a combination thereof), registers, or othermachine components that receive, store, transmit, or displayinformation.

As used herein any reference to “one embodiment” or “an embodiment”means that a particular element, feature, structure, or characteristicdescribed in connection with the embodiment may be included in at leastone embodiment. The appearances of the phrase “in one embodiment” invarious places in the specification are not necessarily all referring tothe same embodiment.

As used herein, the terms “comprises,” “comprising,” “may include,”“including,” “has,” “having” or any other variation thereof, areintended to cover a non-exclusive inclusion. For example, a process,method, article, or apparatus that comprises a list of elements is notnecessarily limited to only those elements but may include otherelements not expressly listed or inherent to such process, method,article, or apparatus. Further, unless expressly stated to the contrary,“or” refers to an inclusive or and not to an exclusive or. For example,a condition A or B is satisfied by any one of the following: A is true(or present) and B is false (or not present), A is false (or notpresent) and B is true (or present), and both A and B are true (orpresent).

In addition, use of the “a” or “an” are employed to describe elementsand components of the embodiments herein. This is done merely forconvenience and to give a general sense of the description. Thisdescription, and the claims that follow, should be read to include oneor at least one and the singular also may include the plural unless itis obvious that it is meant otherwise.

This detailed description is to be construed as examples and does notdescribe every possible embodiment, as describing every possibleembodiment would be impractical, if not impossible. One could implementnumerous alternate embodiments, using either current technology ortechnology developed after the filing date of this application.

What is claimed is:
 1. A computer-implemented method in an electronicdevice of facilitating a checkout for items to be purchased, the methodcomprising: receiving, via a microphone, a set of audio data annunciatedby a user of the electronic device; analyzing, by a processor, the setof audio data to identify a set of keywords included in the set of audiodata; determining, based on the set of keywords included in the set ofaudio data, a set of matching items, wherein at least one of the set ofkeywords is included in each of the set of matching items; modifying theset of matching items according to a popularity associated with each ofthe set of matching items; presenting, via a user interface of theelectronic device, (i) the set of matching items that was modified, and(ii) a transmit selection; receiving, via the user interface, aselection of at least one matching item of the set of matching itemsthat was modified; after receiving the selection of the at least onematching item, receiving, via the user interface, a selection of thetransmit selection; and in response to receiving the selection of thetransmit selection, transmitting, from the electronic device to a pointof sale system an indication of the at least one matching item, theelectronic device being in direct communication with the point of salesystem, and wherein the point of sale system (i) adds the at least onematching item to an order, and (ii) processes a checkout of the orderthat includes at least the at least one matching item.
 2. Thecomputer-implemented method of claim 1, wherein receiving, via the userinterface, the selection of the at least one matching item of the set ofmatching items that was modified comprises: receiving, via atouch-sensitive surface of the user interface, the selection of the atleast one matching item of the set of matching items that was modified.3. The computer-implemented method of claim 1, wherein receiving, viathe user interface, the selection of the at least one matching item ofthe set of matching items that was modified comprises: receiving anadditional set of audio data via the microphone; and analyzing theadditional set of audio data to identify the at least one matching itemincluded in the additional set of audio data.
 4. Thecomputer-implemented method of claim 1, wherein presenting, via the userinterface of the electronic device, (i) the set of matching items thatwas modified, and (ii) the transmit selection comprises: presenting, viathe user interface, (i) the set of matching items that was modified,(ii) the transmit selection, and (iii) a set of codes respectivelyassociated with the set of matching items.
 5. The computer-implementedmethod of claim 1, further comprising: presenting, via the userinterface, a set of training words; receiving, via the microphone, a setof additional audio data representing the set of training wordsannunciated by the user; and based on the set of additional audio data,establishing a baseline speech pattern associated with the user.
 6. Thecomputer-implemented method of claim 5, wherein analyzing the set ofaudio data to identify the set of keywords included in the set of audiodata comprises: analyzing the set of audio data according to thebaseline speech pattern associated with the user to identify the set ofkeywords included in the set of audio data.
 7. An electronic device forfacilitating a checkout for items to be purchased, comprising: a memorystoring a set of computer-executable instructions; a user interface; atransceiver in direct communication with a point of sale system via anetwork connection; and a processor interfacing with the memory, theuser interface, and the transceiver, and configured to execute the setof computer-executable instructions to cause the processor to: receive,via a microphone, a set of audio data annunciated by a user of theelectronic device, analyze the set of audio data to identify a set ofkeywords included in the set of audio data, determine, based on the setof keywords included in the set of audio data, a set of matching items,wherein at least one of the set of keywords is included in each of theset of matching items, modify the set of matching item according to apopularity associated with each of the set of matching items, cause theuser interface to present (i) the set of matching items that wasmodified, and (ii) a transmit selection, receive, via the userinterface, a selection of at least one matching item of the set ofmatching items that was modified, after receiving the selection of theat least one matching item, receive, via the user interface, a selectionof the transmit selection, and in response to receiving the selection ofthe transmit selection, transmit, from the electronic device directly tothe point of sale system via the transceiver, an indication of the atleast one matching item, wherein the point of sale system (i) adds theat least one matching item to an order, and (ii) processes a checkout ofthe order that includes at least the at least one matching item.
 8. Theelectronic device of claim 7, wherein the user interface comprises atouch-sensitive surface, and wherein to receive, via the user interface,the selection of the at least one matching item of the set of matchingitems that was modified, the processor is configured to: receive, viathe touch-sensitive surface of the user interface, the selection of theat least one matching item of the set of matching items that wasmodified.
 9. The electronic device of claim 7, wherein to receive, viathe user interface, the selection of the at least one matching item ofthe set of matching items that was modified, the processor is configuredto: receive a set of additional audio data via the microphone, andanalyze the set of additional audio data to identify the at least onematching item included in the set of additional audio data.
 10. Theelectronic device of claim 7, wherein to cause the user interface topresent (i) the set of matching items that was modified, and (ii) thetransmit selection comprises: cause the user interface to present (i)the set of matching items that was modified, (ii) the transmitselection, and (iii) a set of codes respectively associated with the setof matching items that was modified.
 11. The electronic device of claim7, wherein the processor is configured to execute the set ofcomputer-executable instructions to further cause the processor to:cause the user interface to present a set of training words, receive,via the microphone, a set of additional audio data representing the setof training words annunciated by the user, and based on the set ofadditional audio data, establish a baseline speech pattern associatedwith the user.
 12. The electronic device of claim 11, wherein to analyzethe set of audio data to identify the set of keywords included in theset of audio data, the processor is configured to: analyze the set ofaudio data according to the baseline speech pattern associated with theuser to identify the set of keywords included in the set of audio data.13. A system for facilitating a checkout for items to be purchased,comprising: a mobile device comprising: a first memory storing a firstset of computer-executable instructions, a user interface, and a firstprocessor interfacing with the first memory and the user interface, andconfigured to execute the first set of computer-executable instructionsto cause the first processor to: receive a set of audio data via amicrophone, analyze the set of audio data to identify a set of keywordsincluded in the set of audio data, determine, based on the set ofkeywords included in the set of audio data, a set of matching items,wherein at least one of the set of keywords is included in each of theset of matching items, modify the set of matching items according to apopularity associated with each of the set of matching items, and causethe user interface to present (i) the set of matching items that wasmodified, (ii) a transmit selection, and (iii) a set of codesrespectively associated with the set of matching items that wasmodified, receive, via the user interface, a selection of at least onematching item of the set of matching items that was modified, afterreceiving the selection of the at least one matching item, receive, viathe user interface, a selection of the transmit selection; and a pointof sale device comprising: a second memory storing a second set ofcomputer-executable instructions, and a second processor interfacingwith the second memory and configured to execute the second set ofcomputer-executable instructions to cause the second processor to:receive, from the mobile device, at least one code of the set of codesrespectively corresponding to at least one matching item of the set ofmatching items that was modified, wherein the mobile device transmitsthe at least one code to the point of sale device via a directcommunication in response to receiving the selection of the transmitselection, add the at least one matching item to an order, and process acheckout of the order that includes the at least one matching item. 14.The system of claim 13, wherein the first processor is configured toexecute the first set of computer-executable instructions to furthercause the first processor to: cause the user interface to present a setof training words, receive, via the microphone, a set of additionalaudio data representing the set of training words annunciated by theuser, and based on the set of additional audio data, establish abaseline speech pattern associated with the user.
 15. The system ofclaim 14, wherein to analyze the set of audio data to identify the setof keywords included in the set of audio data, the processor isconfigured to: analyze the set of audio data according to the baselinespeech pattern associated with the user to identify the set of keywordsincluded in the set of audio data.
 16. The system of claim 13, whereinto process the checkout of the order that includes the at least onematching item, the second processor is configured to: receive anindication that the order is complete, and process a payment for theorder.
 17. The system of claim 13, wherein the point of sale device isconfigured to interface with a scale, and wherein the second processoris configured to execute the second set of computer-executableinstructions to further cause the second processor to: receive, from thescale, a weight of the at least one matching item, and manage the orderbased on the at least one matching item and the weight of the at leastone matching item.